A Gestural Interface in a Computer-based Conducting System”, MSc thesis

As the increase of the sales of Wii game consoles, the Wii Remote is able to used as a common input device for a com-puter system. Some software is developed for acquiring the data from the Wii Remote for further processing. This paper presents a Wii-based gestural interface for computer-based conducting systems. It employs the infrared camera in a Wii Remote to capture the conducting gestures of a conduc-tor who is holding an infrared baton, and then represents the gestures using visual and aural representations after data analysis and gesture classification/following. The interface is intended to be used for pedagogy purposes. So it accepts standard conducting gestures, uses an infrared baton simi-lar to a real baton and displays the trajectory of a gesture on the screen which can be compared to the corresponding diagram shown in a textbook. In addition, aural feedback is also supported in this interface. It plays a MIDI note to represent a certain beat in a conducting gesture